Resource Management In Cloud And Big Data Systems

RESOURCE MANAGEMENT IN CLOUD AND BIG DATA SYSTEMSbyLENA MASHAYEKHYAugust 2015 Advisor: Dr. Daniel GrosuMajor: Computer ScienceDegree: Doctor of Philosophy Cloud computing is a paradigm shift in computing, where services are offered and ac-quired on demand in a cost-effective way. These services are often virtualized, and theycan handle the computing needs of big data analytics. The ever-growing demand for cloudservices arises in many areas including healthcare, transportation, energy systems, andmanufacturing. However, cloud resources such as computing power, storage, energy, dol-lars for infrastructure, and dollars for operations, are limited. Effective use of the existingresources raises several fundamental challenges that place the cloud resource managementat the heart of the cloud providers’ decision-making process. One of these challenges facedby the cloud providers is to provision, allocate, and price the resources such that their profitis maximized and the resources are utilized efficiently. In addition, executing large-scale ap-plications in clouds may require resources from several cloud providers. Another challengewhen processing data intensive applications is minimizing their energy costs. Electricity used in US data centers in 2010 accounted for about 2% of total electricity used nationwide.In addition, the energy consumed by the data centers is growing at over 15% annually, and the energy costs make up about 42% of the data centers’ operating costs. Therefore, it iscritical for the data centers to minimize their energy consumption when offering services tocustomers. In this Ph.D. dissertation, we address these challenges by designing, developing,and analyzing mechanisms for resource management in cloud computing systems and datacenters. The goal is to allocate resources efficiently while optimizing a global performance